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WHY INTELLIGENCE TESTS MUST CHANGE 



Over the paat 20 yMr« approxinately , a significant nuRbar of devalopnenta 
have occurred in the fields of human psychology and psycjhometry which, taken 
collectively suggest that we say be due for some sa^or changes in the way we 
conceptualize, and sore isportantly the way we seasure Intelligence. It is 
resarkable that the underlying preslsas upon which the seasureaent of 
intelligsnce has been based continue to hold sway, given the draaatic 
increases in our knowledge of cognitive proceases. In fairneaa, the 
traditional aeasures of intelligence have served long and well, and will 
doubtless continue to be used and defended for some time to cose. 
Nevertheless, the forces for char^-^ are there* The needs of clinicians have 
changod, as they are increasingly being required to provide specific and 
substantiated recosmendations for intervention based upon their asseassents. 
Contssporary thought and theory regarding intelligence is making traditional 
approaches to assessing intelligence increasingly less relevant. Where once 
fAiychometry drove theory, in ths future theory will have to drive psychometry. 

The remainder of this paper will examine the origins of the traditional 
measures of Intelligence, the factors that are making the traditional measures 
less relevant, the obstacles that will continue to atand in the way of change, 
and a brief summary. 

A brief history of intelligence testing 

Sir Francis Galton is ganerally credited with devising the first 
measuremsnt systems which were intended to index differences in human 
intelligsnce (Kaufman, Clark, & Flaitz, in press). It was Galton's belief, 
prsdlcatsd largely upon the work of his cousin, Charles Darwin, that within 
the human spscies graduations of abilities would be found as a consequence of 
genetic variations. GaltonU tests of sensory-motor skills were taken as 
^.ifldsnce of Intsllsetual potaney based on two arguments. Extending the 
philosophies of Loc^ke and Hume, Galton reasoned that all knowledge of the 
world derived from ssnsatlon. Hence the Intelligence of an individual would 
manlf sat Itself in sn msnnsr commensurate with the efficacy of the sensory 
apparatus. The saeond argument waa baaed on the patterna observed in GaltonU 
data* A cloae correlation could ahown between hie meaaurea and independent 
measures of intsllectual statue auch aa the atation of the individual it; 



•ocittty/ Golton's Mthods rMttin^d prc-Minent in England and Europe through 
thm turn of tha century, and they were brought to the U.S. by Janes NcKeen 
Cattell. 

In France, Alfred Binet eucceeded in mounting a challenge to the type of 
eeaeuree Galton advocated, baeed upon hia work for the French Hiniater of 
Public Inatruction. BinetU goal waa to ieplement a teating prograa to 
identify the asadeaically deficient aeong the children entering the public 
achool ayatea. Binet deviaed a battery of aaaeaaaent activitiea which tapped 
general fund of knowledge, verbal akilla, aeaory, and reaaoning (Binet & 
Siaon, 1899) • Theae aeaaurea were graduated in complexity and difficulty to 
be appropriate for varioua age groupa. The inatruaent waa intended to be 
interpreted aa an index of academic readineaa. 

For a brief period at the turn of the century, the teating movement lost 
momentum aa the reault of a couple of widely reported atudiea. Wiaaler (1901) 
and Sharp (lB98-99> inveatigated the meaaurea of Binet and Qalton and found 
little empirical evidence of a relationahip between thoae meaaurea and other 
indieatora of academic or intellectual ability. In time, deficienciea in theae 
atudiea aaaociated with aample aize and reatriction of range were recognized, 
buth the general enthuaiaam for teating waa dampened until the outaet of World 
War I. At that time, the need aroae for efficient methoda of aelecting among 
newly inducted membera of the armed forcea. While Binet'a acalea were the 
more widely accepted meaaurea of ability, the one-to-one method of 
adminiatration waa not well auited to the enormity of tha taak. Otia ia 
credited with the development of a paper-and-pencil form of the Binet acalea. 
Alao during thia proceaa, the problem of illiterate and non-Engliah apeaking 
teat-takera aurfaced. Non-verbal acalea (aubaequently known aa Army Beta) 
were deviaed to aaaeaa the general intelligence of recruita who could not be 
velidly aaaeaaed with the paper-and-pencil teat form (Army Alpha) • Following 
the war # the uae of Intelligence teata, often virtually unchanged from the 
Army forma, proliferated in buaineaa and education (Kaufman & Flaitz, in 
preaa). 

A aignif leant mileatone in the hiatory of intelligence teating came about 
aa a reault of the work of David Wechaler. Wechaler, who uaa primarily a 
clinician by tra^i^^ waa a unitary trait, 

it waa mahi and important clinical information could 

be d^^ from a battairy that aaaeaaed verbal and non-verbal aapecta of 



intttlligmet aeparotftly. Th« rwult waa th« Wttchaler Intelligence Scale for 
Children («ISC) end the Mecheler Adult Intelligenc4i Scale (WAIS). Both acaloa 
have undergone reviaion, aa haa the Stanford-Binet, an American version of the 
Binet acalea. 

SbSS^SSiiOaS si traditional Beaaurea of intelligence 

Both the Wechaler acalea and the Stanford-Binet have their roota in the 
acalea of Alfred Binet ^ dating back to the turn oi the century. Binet 
evidenced aoae reluctance to deacribe hie acalea aa aeaaurea aa intelligence^ 
although enthuaiaata ahowed no aitilar reaer/ation. Lewie Terpen aay be acre 
reaponaible than anyone elae Tor inextric^/oly linking Binet'a acalea with the 
concept of intelligence. 

Perhapa ironically « it My be that the available inatruaentation did acre 
to drive theorizing about intelligence than theory ha;^ ever done to ahape the 
nature of the aeaaurea. The circuaatancea led Boring to offer th^. well known 
obaervfltion that **intelli:!ence ia v;hat intelligence teata ftsaaure*' (Boring^ 
1923). 

The theoretical underpinninga of the traditional aeaaurea of intelligence^ 
auch aa they arm, e»iated at the tiae that Binet undertook the development of 
hia firat acalea nearly 90 yeara ago. After BinetU acalea had bf>mn in uae 
for aeveral yeara» Charlea Spearaan (1904) outlined a general theory of 
intelligence that propoaed the exiatence of the g factor to account for the 
cloae correlation of apparently diatinct aeaaurea of ability^ auch aa Binet'a 
acalea on one hand aiid Cal ton U acalea on the other. Spearaan 'a theory 
actually aerved aore to validate the aeaaurea of Galton and Binet than to 
influence thea. The two factor theory of intelligence offered by Spearaan 
thua can be aeen aa an atteapt to account for the exi&ting data produced by 
extant acalea/ rather than aerving aa the catalyat for inatruaent developaent. 

Soae yeara later/ Thuratone (1936) auggeated an alternative theory of 
intalligunctt in ra.penM to apparant •tati«tieol anoaali.. in Spaaraan's work. 
Thuratona ehoaa to aaploy a factor analytic aathodology in atudying tha 
aaaauraaant of intalliganea* and ha propoaad that aora than ena factor aight 
akiat to anplain tha aharad varianca aaong a aat of acalaa. Thuratone 
aubaaquantly idahtifiad nina factora which ha baliavad to rapraaant prinary 
■;abilit4aa.^.;7 ^ . 
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Raymond B. Cattttll (1963) Bought to rsaolve the apparent diacrapanciea 
•xlating b«twaan Spaaraan'a two factor theory and Thuratona'a primary 
abilitiaa aodal. Ha fait thia raaolution could be daaonatratad whan 
aacond-ordar factor analyaia waa applied to the pria«ry ability factora, with 
the emergence of a aingle auper -ordinate factor akin to Spearaan'a g. Cattail 
went on to elaborate hia theory which emerged aa the theory of fluid and 
cryatallized intelligence. 

Thuratone waa reaponaible for developing a number of maaauraa including 
the Primary Abilitiea Teat» and Cattail and Horn have produced o number of 
meaaurea of ability, and yet none of theaii have auecaaafully croaeed over from 
the experimental lab, where they were developed, to the general marketplace. 

Guilford (1979) haa propoaed a far mora ambitioua theory, the 
Structure-of -Intellect Hodel, which auggeata that intelligence exiata in three 
dimenaiona- operationa, content, and producta. Vith S identified typea of 
operationa, 4 typea of content, and 6 types of products, Gullford'a model 
ultimately poaita 150 typea of intelligence. Guilford and hia aaaociatea have 
aueceeded in developing inatrumenta which aaaeaa ao9\e of the 150 categoriea, 
but the tecta have generated little commercial interest. 

While thera are other important theoretical modela of intelligence, the 
point ia eatabliahad that the traditional, commercially auccessful meaaures of 
intelligence are in no way baaed upon or cloaely related to any ma^or 
theoretical poaition. Moreover, theae intelligance tests have not changed 
significantly for approximately 60 yeara. 

Of even greater concern than the obaervation that traditional teats of 
intelligence were not initially formulated along explicit theoretical lines is 
the recognition of how far reaearch and thc^ory have moved aince theae teata 
were first established. Perhapa moat central to the new thruat of theory into 
the topic of inteiligenee ia the treatment of intelligence aa a flexible and 
fluid proeeaa or procaaaea which develop over the lifespan of the individual. 
Alao of importance haa been the attempt ta link cognitive proceaaea with brain 
phyaiology. Among the theoriat and raaeiirchera who hove actively aought to 
introduce thia alternative view of intelligence are Piaget, Horn and Cattail, 
end Oaa ^ Kir by and Jar man . 

tt^ ^ajor theoretical poaition, it can be auggeated 

thai Piagit^r^^^ of intelligence differed aignificantly from 

tJie traditibnoi;^ in several waya. Rather than 



trMting intalllgftnce aa an Innata capacity factor, Piagat (1972) viowad 
intalllganca aa a davalopaantal procaaa, groundad in an invariant aaquence of 
atagaa during which Intallectual aklll waa aanifaatad In a qulta dlatlnctive 
aannar, llaitad by Inharant charactarlatlca of tha ataga. What la iaplicit In 
Plagat'a nork la tha auggaatlon that intalllganca la not tha aaaa thlnga at 
all atagaa of an Indlvldual^a Ufa, and that whila tha procaaaaa that 
ultlaataly dictato tha prograaaiva unfolding of Intallactual functioning aay 
ba datarainiatlc, tha traditional aathoda of aaaauring intalllganca cannot 
ada^uataly daal with tha dramatically diffarant Mnifaatationa of intalllganca 
which ariaa at varioua atagaa of intallactual davalopaant. Mora racantly, 
nuaaroua raaaarchara (a.g., Coaacnar, at al., 1982; Kitchanav, 1983; Kraaor, 
1983) hava of farad tha opinion that for adulta it 15 nacaaaary to poait a 
ataga of eognitiva functioning bayond Plagat'a formal oparationa; a ataga 
charactariMd by a naw form of f laxibility in daallng with problaaa having no 
aiapla and aeiantific aolution. Again tha implication ia that if tha 
intallactual functioning of tha individual la to ba appropriataly gaugad, the 
Inatrumantation of that aaaaaamant muat in noma way incorporata machanlama for 
addreaaing tha diatinctiva natura of intalllganca at any givan ataga. 

Horn and Cattail (1966), whoaa thaory of fluid and cryatalllzad 
intalllganca haa alraady baan alludad to, ropraaant anothar Important 
dapartura from traditional approaehaa to aaaaaa intallactual functioning. In 
an articla daallng with tha laaua of cultura fair taatlng. Cattail (1979) 
pointa out that traditional taata of intalllganca hava baan and contlnua to be 
tha aaaaaamant toola of choice baaed upon their eff ectiveneaa in predicting 
academic achievement, but that thia application ia ultimately a very narrow 
one. Following World Ware 1 and ZZ, traditional taata of intelligence did a 
poor 3ob of predicting how well an adult leaving achool would do in learning 
to fire a naval gun or fly a plane. Cattail aaeribed thia felling to the 
abaenee of any fluid intelligence component to the traditional intelligence 
teata, and auggeated that the 20% of purely acholaatie knowledge variance 
found in traditional taata of intelligenee would actually reduce predictive 
validity in much aituationa, aa it introduced mialeading, ayatematie error. 

Daa, Kirby, and Jarman (1975) have advanced a eomprehenalve theory of 
int #iliganee and cognitive functioning baaed upon e model of information 
proceaaing which can be broadly linked to apecif ic cortical areaa. Their 
theory ia rooted in th^^ who obaerved that the cortex ia 



•ngag^d in two typM of integrative octivity- •inultaneouA and aucceaaiva. 
Luria divided tha brain into thraa aaor functional units- tha arouaal and 
attention unit located in the upper brain atea and reticular foraationj the 
inputs recodingp and atorage unit located in tha occipital, parietal, and 
frontal -teaporal regiona; and the unit for planning and prograaaing behavior, 
located in the frontal lobe. Extenaive reaearch with the aodel lead Daa^ 
Kirby, and Jaraan to conclude that a legitiaate aiaultaneoua-aequential 
dichotoay in proceaaing exiata, and that the aore traditional aodela that 
treat rote iieaory (which dependa heavily upon aequential proceaaing) aa 
aubordinate to problea aolving (which iapliea aiaultaneoua proceaaing) are 
incorrect* Por aaaeaament, the iaplication of the work of Daa, ><lrby, anvi 
Jaraan (and by extenaion, Luria) ia that to appropriately neaaure 
Intelligence, an inatruaent auat poaaeaa the capacity to Qaaeau aiaultaneoua 
and aequential proceaaea aeparately. Their work haa auggeated that theaa two 
proceaaea adequately account for variationa in cognitive functioning in 
childreni however, in adulta, an aacaMaent inatruaenc would alao need a third 
coaponent to addreaa the pletming proceaa, which appeara to nanifeat itaelx 
(in Piagetian-like faahion) only aa the individual aaturaa. 

In the area of neuropayehol^igy, the work of Bogen (1969), Sperry (1968), 
Luria (1970), and Gazxaniga (1970) haa proven invaluable in underatanding the 
aanner in which the brain funct.lona and ia integrated in thoae functiona. 
Beginning with Sperry'a aplit brain atudiea, it haa bacoae evident that in 
aoae faahion the brain functiona in two dlatinct aodalitiea. While it haa 
been auggeated that thia dichotoay repreaenta a left brain-right brain 
functioning (Bogen, 1969: Sperry, 196a) Luria haa auggeated that the diviaiona 
of the brain are nore coaplex. Whatever the ultiaate reaolution of the 
problea of location of apecifie brain function, it ia clear that the 
methodology exiata for aaaningfully atudylng the linkage between brain 
atrueture and brain function, and that aaeeaaaent toola for the aeaaureaent of 
brein function auat in aoae faahion acknowledge the growing body of knowledge 
concerning the funetion*atrueture relat:;onahip» 

When the fiinet eeelea were f Irat developed, their purpoae waa aiaply to 
Identify children who wer<% alow or not prepared for aehool* Aa auch, the 
Mjor evidence for their validity ateaaed froa the ability of the acalea to 
predict aeadeaie aehieveaent. At that tlae there waa little concern that the 
inatruaent eight itaelf be heavily loaded on aeadeaie aehiCiveaent. Wechaler 



produced hiA AcalM to Aarvs « Alightly diffarftnt purposft^ noftely to oaaiat in 
th« clinical diagnoaia of intallactual iapairaent (Vachaler, 1975). To that 
•xtant^ tha Vachalar acalaa aight ba aaid to coaa cloaar to tha theoratical 
idaal of intalliganca than do tha Binat acalaa. Howavar, avan ir; tha caae of 
tha Wachalar acalaa^ thair uaa haa moat oftan baan an a aaana of confirming or 
diaconf iraing an hypothaaia of dyaf unction # or 4%a a aachaniaa for tha 
idantification of tha aourca of dyaf unction. 

Evanta of tha paat dacada hava praaantad naw challangaa to tha clinician 
attampting to aaploy intalliganca taat!«. Thar a ara thoaa who call for tha 
abolition of all intalliganca taata. siting pr^blaaa of abuaa and biaa. On 
tha othar hand, many eliniciana ara obligad to utiliza thaaa aaaa taata in 
rigid and aachanical faahion, ignoring tha known liaita of tha taata in ordar 
to comply with buraaucratic mandataa. In part tha problam ia ona of practica; 
that ia, tha clinician muat hava auparior powara of infaranca and daduction 
than tha inatrumanta ha uaaa. But tha clinician ia nonathalaai liaitad to the 
•xtant that tha taata ha haa availabla provida littla inforaation bayond tha 
ability to diatinguiah function from dyaf unction, and to produce a label for 
the dyaf unction. The findinga of clinical a«aeaament muat lead to aoae 
•peeifie intervention which will benefit the client, and muat itaelf generate 
information that tuggaata appropriate intervention atrategiea. In l^.rge part 
thia requirement of elincal aaaeaament haa not teen met by traditional teata 
of intelligence. 

One laat aource of difficulty for tha traditional meaaurea of intelligence 
relatea to their apppropriateneaa for uaa with adulta. Tha Binat acalaa were 
created for tha expreaa purpoM of aaeaaaing functioning of children. The 
extenaion of the teat to young adult and/or adult populationa repreaenta 
little more than an act of faith predicated on the tenet that intelligence ia 
atatie, or at moat aeeretienal. While the Wechaler acalaa were developed in 
aueh aa manner aa to reault in aeparate inatrumenta for children and fidulta, 
•xamination of the aubteata of each form reveal a remarkable degree of 
overlap. Again, thia ia praavt^ably due to the traditional view of 
intelligence aa relatively immutable and unchanging over the li^reapan. The 
Mjor eoneeaalona to tha delineation of child and adult intelligence on the 
two forma of the Wechaler aealea appear to be a alight redefinition of aome of 
the taaka (typioally making them more difficult) and the proviaion of 
age-appropriate norma. Aa waa earlier n9':fd. Cattail addreaaad the problem of 



MSMsing odult intelligMc*^ pointing out the disappointing perfomance 
ofptraditional acalea in predicting outcoaaa that are aore relevant for adulta 
than acadeaic achieveaent. 

The queation of developmental changea in intellectual potency in the later 
adult yeara haa created controvery aa well. The importance of the question 
grci^a aa the U.S. population becoaea older. The traditional view^ baaed on 
trenda obtained froa croaa-sectional analyaia of intelligence teat acorea 
holds that following late adoleacence the intellectual function aa represented 
by a graph line firat plateaua and then declinea in the later years. 
Interpretation of thia data haa differed though. One interic.-etation is that 
intellectual potency declinea with age, while jn alternative hypotheais 
suggests that cohort differencea in croaa-aectional atudiea, and intervening 
history in longitudinal atudiea are reaponaible for the appearance of these 
differences (Scheie, 1972). However, both caapa aeea to agree that the 
inatruaenta typically employed in the atudy of intellectual functioning are 
poorly auited to the meaaurement of intelligence in older adulta. 

The future of intelligence tsfiting 

The aorta of changea needed in the intelligence teata of the future are 
readily inferred from the limitationa of today 'a teata. They muat be more 
theory*baaed, and apeeifically muat addreaa theoretici^l iaaues that have 
ariaen over the paat twenty yeara. Given that much of the contemporary work 
in the area of intelligence haa tended to conceptualize intelligence aa 
proceaa-baaed, it f ollowa that meaaurea of intelligence in the future muat 
focua on the proeeaaea of cognitive functioning rather than the auppoaed 
product of thoae procesaea. Another feature of tomorrow' a intelligence teata 
will hopefully be a more relevant contextual baaia, eapecially ao for measures 
intended to aaaeaa adult intelligence. That ia to aay, the nature of the 
itema and taaka of the teat ahould be related to the typea of taaka and 
eircumatanees more typical of adult life than ia true at preaent. Because 
tomorrow 'a teata muat be more clinically uaeful, it ia likely ^;hat they will 
somehow generste, more readily, diegnoatie information that can be applied to 
intervention. Thua, the intelligence teat uaed in the academic aetting would 
ideally tell the instructor important Information regarding the teat-takera 
potential for learning apeeifie typea of akilla. Finally^ it may be that more 
tostSr designed for relatively narrowly defined purpoaen, will emerge and 



«chi.ttv« co-ttqual proAinanc* with tMta intended to produce global aaaeaaaenta 
of intelligence. 

The moat coaplete exaaple of toaorrowU teata available today may be the 
Keufaan Aaaeaaaent Battery for Children (K*ABC>. The K-ABC ia theory-baaed, 
utili2ing the principlea of aeversl theoriea (e.g., Daa, Kirby, and Jaraan, 
1979; Luria, 1970; end Horn and Cattail, 1966). It ia proceaa-oriented. And 
perbapa of greateat aignif icance, the inatruaent yielda data that can guide 
the teacher to productive activitien which will benefit thf child. Other 
inatruaenta which ahare the featurea of theory-baaed, proceaa-oriented, and 
diagiioatically uaeful ire under developaent (e.g., Sternberg, 19ft5; 
Feueratein, 1979; Cardnar, 1983; Hunt, 1978). Additionally, aignif leant 
atridea are already being aade in the eoaputerlzation of certain aapecta of 
intelligence toating, which aay reault in aore efficient teating. 

While there ia auch reaaon for optiaiaa in the area of intelligence 
teating in the future, certain factora will iapede the rapid reatructuring of 
the field. The foreaoat obatacle would appear to be the teat publiaher. Thi> 
hiatory of intelligence teating aeeaa to reveal nearly aa auch about teat 
publlahing aa it doea about teat developaent. Teat publiahera underatandably 
hove a major inveataent in the teata that are currently popular, and will be 
hard preaaed to either abandon thoae teata or to even-handedly proaote newer 
and potentially aore prcr^iaing teata. Factora of coat and aarket control 
aiallarly aake it difficult for new publiahera to appear on the acene offering 
auperior producta for coapetitive pricea. Thua it ia clei»r that publiahera 
will be a force of inertia for the foraeeable future, juat aa they have been 
in the paat. 

A related obatacle ariaea froa the habita of today 'a teat uaera. 
Publiahera reapond to aarket deaand, end if a reaarkable new deaand for new 
teata were to eaerge, aore than one publiaher would undoubtedly reapond to the 
deaand. However, the current uaera of teata to a large extent content 
with the teata currently available to thea. Perhapa aore accurately, they 
have learned to ecGoaaodate theaaelvea to the exlating ahortcoainga in today' a 
teata (or are uneware of thoae ahorteoainga) . Whatever the caae until teat 
uaera want better teata, the pabliahera are ualikely to begir supplying new 
teata. The key to what toaorrow'a teat uae?ra will deaand aay lie with the 
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prograna thcit train thoae individuala* Like Thonaa Kuhn'a description of 
change in science, it may be that the chenge in habita of teat users will be 
based sore upon attrition than upon a broad--based change in attitude sMong 
existing users. 

Today's tests of intelligence ere largely unchanged over the past 70 to 80 
years, despite substantial changes in the way intelligence is conceptualized. 
The history of intelligence testing reveals that such sore has been done to 
perfect the seasuresent of traits that are static end immutable than has been 
done to make or keep intelligence tests relevant. 

The ma^or factors that make today's intelligence tests suspect ere the 
advances in theory, especially so in the area of cognitive paychology, more 
extensive needs of clinicians, and changes in the populations with which 
intelligence tests are being used. Tomorrow's tests will have to be more 
theory-based, produce better diagnostic information, and be relevant to the 
types of test-takers with which they will increasingly be usee. However, 
changes in tests will not occur overnight, as publishers will not move rapidly 
in the absence of a proven market, and the market will not arise until test 
users are widely educated to the deficienciea of the existing tests and the 
promise of tomorrow's tests. 
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